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Abstract 

Let  X  =  {A'(<)  ;  <  >  0^  be  a  positive  recurrent  synchronous  process  (PRS),  that  is,  a 
process  for  which  there  exists  an  increasing  sequence  of  random  times  r  =  such 

that  for  each  k  the  distribution  of  ^t(*)  o  X  =  {A'(t  +  ’’’(h})  :  t  >  0}  is  the  same  and  the 
cycle  lengths  Tn  =  r(n  +  l)  — r(n)  have  hnite  first  moment.  Whereas  the  ergodic  properties 
of  such  processes  are  well  known  in  the  literature,  the  same  is  not  so  for  the  distributional 
properties  of  either  the  marginals  X{t)  or  more  generally  the  shifted  processes  $,X  = 
{A'(s  +  <)  :  ^  ^  O)  in  function  space.  In  the  present  paper  we  show- that  these  distributions 
are  in  fact  tight.  In  contrast  to  classical  regenerative  processes  wa  also -show  that,  the 
standard  types  of  regularity  assumptions  (non-lattice  cycle  length  distribution,  mixing) 
do  not  ensure  weak  convergence  to  steady-state  for  a  PRS.  Applications  are  given  in 
the  context  of  one-dependent  regenerative  (od-R)  processes.  These  arise  in  the  queueing 
models  that  motivated  this  paper. 
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1.  Preliminaries 


Throughout  this  paper,  -V  =  {A'(t)  :  t  >  0}  will  denote  a  stochastic  process  with  a  complete  separable 
metric  state  space  5  and  having  paths  in  the  space  D  =  D5[0,oo)  of  functions  f  :  R+  —>  S  that  are  right 
continuous  and  have  left  hand  limits.  T>  is  endowed  with  the  Skorohod  topology  and  is  a  complete  separable 
metric  space.  {Q,  T ,  P)  will  denote  the  underlying  probability  space  and  we  view  A  as  a  random  element 
of  V.  Let  A  denote  an  arbitrary  fixed  element  not  in  the  set  5.  We  then  endow  S  S  O  {A}  with  the 
one-point  compactification  topology. 

Definition  1.1.  X  is  said  to  be  a  synchronous  process  with  respect  to  the  random  times  0  =  r(-l)  < 
r(0)  <  r(l)  <■■•('  with  limn— oo  a.s.  )  if  {Xn  •  ti  >  2}  forms  a  stationary  sequence  in  the  space 

where 

-  ,  .  _  J  A'(r(n  -  1)  -I- 1),  ifO  <  t  <  T„; 

An(f)-jA,  ift>Tn. 

T„  1=  r(n)  -  r(n  -  1)  is  called  ike  cycle  length,  A„  is  called  the  n*'*  cycle  and  we  refer  to  (r(n))  as  the 
synch-times  for  X  with  counting  process  N{t)  =  majc{n  >  0  :  r(n)  <  <}. 

The  important  point  here  is  that  at  the  random  times  T{k),  A(<)  and  its  future  probabilistically  start 
over.  However,  in  contrast  to  classical  regenerative  processes,  the  future  is  not  necessarily  independent  of 
any  of  the  past  {r(l), . . . ,  r(fc);  A(s)  :  0  <  s  <  T{k)].  In  particular  r  does  not  (in  general)  form  a  renewal 
process  and  hence  the  renewal  equation  does  not  apply  to  synchronous  processes. 


Definition  1.2.  A  synchronous  process  X  is  called  non>delayed  if  r(0)  =  0  a.s.;  delayed  otherwise.  It 
is  called  positive  recurrent  if  E{Ti)  <  oo,  null  recurrent  otherwise.  A  rfTTJ  caJled  the  rate  of  the 
synch  times. 


From  now  on,  PRS  will  be  used  to  abbreviate  positive  recurrent  synchronous  process. 

Other  names  have  been  given  to  a  synchronous  process;  for  example  Serfozo  [1972]  refers  to  them  as 
semi-stationary  processes.  In  RoL‘<ki[l98l]  they  arise  as  Palm  versions  of  stationary  processes  (associated 
with  pomt  processes).  Closely  related  to  this  is  the  general  theory  of  stationary  marked  point  processes. 
In  any  case,  the  ergodic  properties  of  synchronous  processes  are  well  known  in  the  literature.  We  state 
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several  such  results  the  proofs  of  which  can  be  found  in,  for  example  Baccelli  and  Btemaud  [1987],  Daly  and 
Vere-Jones[1988],  Franken  et  al  [1981],  Glynn  and  Sigman  [1989],  Rolski[1981]  and  Serfozo[1972]. 

Let  9,  :  Vs  — '  Vs  denote  the  shift  operator  (9ix)(s)  =  x(t  +  s). 

Theorem  1.1.  Suppose  X  is  a  PRS  and  f  :Vs  is  measurable.  Let  Jn  =  Jn{f) 
ff  7o(|/|)  <  oo  a.s.  and  if  either  /  >  0  a.s.  or  £'{/i(|/|)}  <  co  then 

...  (U) 

where  I  denotes  the  invariant  <T-field  associated  with  {(.Y„,7’n)}- 

Let  P°  denote  the  probability  measure  under  which  X  is  non-delayed,  that  is,  P°{X  ^  A)  =  P(6rii)°X  G 

X). 

Corollary  1.1.  Under  the  conditions  of  Theorem  1.1,  if  in  addition  I  is  trivial  (every  set  has  probability 
0  or  1)  then  {Jn,T„  ;  n  >  1}  is  ergodic  and  hence  a.s. 

Urn  7/‘/(0.oX)ds=  |i^  =  A  r  P°i9,oX^A-,T(l)>s)ds.  (1.4) 

l-ootJo  Jq 

Under  these  circumstances,  X  is  called  ergodic. 

The  following  Corollary  follows  from  (1.1)  by  an  elementary  application  of  Fubini’s  Theorem  and  the 
Bounded  Convergence  Theorem. 

Corollary  1.2.  Under  the  hypothesis  of  Theorem  1.1,  if  in  addition  f  is  bounded  then 

?,(/) «  i/w*.  »  -  .(/)  E  { 11^}  (1.5) 

T  above  defines  a  measure  on  V  and  (for  reasons  given  below  in  Proposition  1.1)  is  called  the  stationary 
probability  measure  for  X.  fn  particular,  by  choosing  /  =  ly»  (an  indicator  function),  we  have  p,(  A)  —  5r(A) 
for  each  Borel  set  A  ofV;  thus  the  Cesaro  averaged  distributions  converge  weakly. 

Proposition  1.1.  Let  ir  be  the  stationary  measure  of  a  PRS  X.  Then  under  ir,  9  =  (9,)  is  measure 
preserving  on  V,  that  is,  for  each  Bore!  set  A,  ir(A)  =  t(0_,A)  for  all  s  >  0.  In  particular,  if  X  has 
distribution  ir,  then  X  is  time  stationary,  that  is.  9iX  has  the  same  distribution  for  each  t  >  0. 


.1 


Let  P*  denote  the  probability  measure  under  which  A'  has  distribution  tt,  that  is,  P'{X  €  A)  =  ;r(/l). 


From  (1.4)  we  obtain  for  an  ergodic  synchronous  process  that 


rOQ 

p'{X£A)  =  x  /  p°{e,ox  e  a-,t{\)>  s]ds. 
Jo 


(1-6) 


If  X  is  positive  recurrent  but  not  ergodic  then  the  RHS  of  (1.6)  still  defines  a  measure  on  T>  (but  not 
necessarily  the  same  as  the  ir  from  (1.5)).  In  fact,  more  can  be  said: 

Proposition  1.2  For  a  PRS  the  RHS  of  (1.6)  dednec  a  measure  on  V  (in  general,  not  the  same  as  tt)  under 
which  &  =  (9 3)  IS  measure  preserving. 


Proof:  Clearly  the  RHS  of  (1.6)  defines  a  probability  measure  on  D.  Call  this  measure  t-  Then 

H9.tA)  =  A  /  P°(d,+,  oXeA;  r(l)  >  s)ds 

Jo 


=  XE{  f  I4et+.x)ds} 

Jo 

=  A£{  J  lA{S.X)ds} 

ft  rT(l)+t 

^tf>(A)-XE{  lA{9,X)ds-  lA{9,X)ds}. 

Jo  Jt(1) 


It(1) 

The  result  follows  since  (by  the  definition  of  synchronous)  the  last  two  integrals  above  have  the  same 
distribution.  ■ 


Let  X  be  PRS  with  steady-state  distribution  tt.  One  might  expect  to  obtain  weak  convergence,  as 
t  — ►  00,  of  the  measures  i/,  1=  P(X(t)  €  •)  or  pt  -  P(9tX  e  •)  by  placing  some  further  regularity 
assumptions  on  X  such  as  a  non-lattice  cycle  length  distribution  and/or  mixing  cycles.  Unfortunately,  as 
the  following  example  shows,  one  must  be  very  careful  in  asserting  stronger  modes  of  convergence  for  a  PRS 
than  the  Cesaro  type  obtained  from  Theorem  1.1  or  Corollary  1.2. 

Example  (1)  A  PRS  having  both  a  spread-out  cycle  length  distribution  and  mixing  cycles  that  does 
not  converge  weakly.  Let  B(i)  denote  the  time  until  the  next  integer  point  strictly  after  time  t.  This  is 
actually  the  forward  recurrence  time  for  a  renewal  process  {tn}  with  t„  =  n,  n  >  0.  The  steady-state 
marginal  distribution  of  B  is  Unif (0,1).  Also,  since  B  is  regenerative  (it  regenerates  at  times  <„),  B(t) 
converges  in  the  Cesaro  sense  to  Unif{0, 1)  regardless  of  initial  conditions. 
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Let  [Un)  be  i.i.d.  ~  U ni/(.5, 1)  and  define  r(n)  =  n  +  Un-  In  particular  n  +  .5  <  r(n)  <  n  +  1,  n  >  0, 
and  the  cycle  lengths  T„  W  T(n)  -  T(n  -!)  =  (/„-  D'n_i  +  1  are  one-dependent,  that  is,  T„  depends  upon 
Tn+i  but  is  independent  of  k  >  2.  Moreover  the  cycle  length  distribution  has  an  absolutely  continuous 
component  and  hence  is  non-lattice  and  spread-out.  Clearly  B  is  PRS  wrt  r  and  the  cycles  of  B  are  also 
one-dependent.  In  particular  they  are  mixing,  that  is,  P(A'n  £  A,Xk+n  £  B)  -  P(X„  £  A)P(X*+„  £  B) 
tends  to  0  as  jfc  tends  to  oc  for  all  sets  A,  B.  Now  consider  the  delayed  version  (with  respect  to  r);  B(0)  =  1. 
In  this  case  B{n)  =  1,  n  >  1.  Weak  convergence  is  therefore  impossible  since  if  B{t)  converges  weakly 
then  its  weak  limit  must  be  Unif{Q,  1)  (the  same  as  its  Cesaro  limit)  and  all  convergent  subsequences  B(o>i) 
must  converge  to  Unif{Q,  1)  also.  In  fact  we  now  will  show  that  the  non-delayed  version  (with  respect  to  r) 
X{t)  =  Bt,+(  also  does  not  converge  weaikly.  To  this  end  simply  observe  that  at  times  =  (2n  +  l)/2  we 
have  .5  <  X(sn)  <  1  and  hence  no  mass  occurs  on  (0,  .5).  But,  as  before,  X(<)  converges  to  (7ni/(0. 1)  in 
the  Cesaro  sense,  since  X  is  actually  the  same  as  B  with  the  random  initial  condition  B(0)  =  ■r(l). 

Given  a  synchronous  process  X  define  a  new  process  A'  by  ■A'(t)  =  6t  o  X . 

Proposition  1.3  If  X  is  synchronous  then  X  is  synchronous  with  the  same  synch  times  as  X.  The  paths 
of  X  are  continuous;  in  particular  they  lie  in  V-Ds- 

Proof:  The  state  spau:e  of  X  is  the  complete  separable  metric  space  Vs.  Moreover,  the  sample  paths  of 

X  are  actually  continuous,  that  is,  if  x  £  T  and  s  — ►  t  then  0,x  — -  i?,x  in  the  Skorohod  topology  of  V 
(see  Lemmal.l  of  Rolski(1981])).  It  is  immediate  from  the  definition  of  synchronous  process  for  X  that  the 
distribution  of  X  (and  its  future)  starts  over  at  the  synch  times  of  A.  ■ 

Remark  (1.1):  In  the  case  of  a  discrete  time  process  {X(i)  :  /fc  >  0},  one  can  convert  to 
continuous  time  by  defining  X{t)  =  X([t|). 

2.  Tightness 

Although  weak  convergence  of  a  PRS  can  not  be  obtained  in  general  (and  placing  conditions  on  the  cycles 
does  not  appear  to  help),  we  do  have 

Theorem  2.1.  A  PRS  is  tight,  that  is.  for  each  e  >  0  there  exists  a  compact  set  K{c)  C  *!>  such  that 


a 


P{X{i)  €  A'(e))  >  I  —  e  for  all  t  >  0.  la  fact  {Gt  °  X}  is  tight,  that  is.  for  each  e  >  0  there  exists  a  compact 
set  C{c)  C  V  such  that  P((X)(t)  €  C(e))  >  1  -  e  for  all  t  >  0. 


Proof:  Let  t/i  denote  the  measure  from  Proposition  1.2.  Let  F(x)  denote  the  cdf  for  r(l).  Fix  €  >  0  and 

then  choose  an  a  =  a(e)  >  0  such  that  F(a)  <  eX/2  (Recall  that  we  are  assuming  that  the  cycle  lengths  are 
strictly  positive).  From  (1.6)  it  follows  that 


W{A) 


>./■ 


P°{e.oX  €  A;t(1)  >  s)ds 


>a/- 


P°ie,oX  6  A;r(l)  >  a)ds. 


(2.-; 


Observe  that 


P°(e,  o  A'  e  A)  =  P°{0,  aX  €A-,  r(l)  >  a)  +  P°{e,  o  AT  6  A;  r(l)  <  a) 


<  P“(0,  o  A  €  A;  r(  1)  >  a)  +  F(a). 
Substituting  the  above  into  (2.7)  we  obtain 


xl>{A) 


>  \  r  p°{6. 

Jo 


oX  €  A)ds-aF{a), 


and  hence 

r  P°{6.  o  A  €  A)ds  <  A- V(A)  +  ae/2.  (2.8) 

Jo 

For  each  u  >  0  and  each  compact  set  B  of  5  define  A(B,u)  =  {x  G  P  :  x(t)  G  B;t  G  [u.u  +  o]}.  By  the 
com.pact  containment  condition  (see  Ethier  and  Kurtz[1986],  remark  7.3,  page  129)  there  exists  a  compact 
set  Ki  =  Ki{e,a)  in  S  such  that 

t/^(A(Ai,u))>  l-Aae/2.  (2.9) 


Moreover,  by  stationarity  of  A  under  rii,  Ki  doesn’t  depend  upon  u.  For  any  set  A  let  A  denote  the 
complement  of  the  set.  From  (2.8)  and  (2.9)  we  obteun 

/  P°(9,oX  eA{Ki,u))ds  <  A-V(A(A'i.u))  +ae/2 

Jo  (2.10) 

<  Of. 

But  u  +  a  G  s  +  [u, u  +  a]  for  each  s  G  [0,  a]  and  hence  for  each  s  G  [0,  o]  P°(X(u  +  a)  G  A'l )  <  P°(Gs  °  A'  G 
A(Ai,u)).  Substituting  into  (2.10)  yields 


P°(A(«  +  a)  G  Ai)  <  f,  «>0, 
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or  equivalentJy 


P°iX(t}e  Ki)>  l-e.  t>a.  (2,11) 

Using  the  compact  containment  condition  again  there  exists  a  compact  set  A'2  =  /<'2(f,a)  such  that 
6  A(K2,0))  >  1  -  in  particular  P°(A'(t)  6  K2)  >  1  -  e  for  all  t  6  [0,a].  Thus  for  A',  =  Ki  U  A'2 
we  obtain  P°(A'(1)  £  A,)  >  1  —  e  for  all  t  >  0.  Thus  we  have  shown  that  the  marginal  distributions  of  a 
tion-delayed  PRS  are  in  fact  tight.  Moreover,  by  Proposition  1.3  we  also  obtain  tightness  of  the  non-delayed 
A.  To  handle  the  delayed  case,  suppose  A'  is  delayed,  fix  f  >  0  and  choose  an  M  large  enough  so  that 
P(r(0)  >  M)  <  €.  Then  for  any  compact  set  A'  if  <  >  M  then 

P{X(t)  €  TT)  <  €  A;  r(0}  <  M)  +  e 

<  P(  A'(r(0)  +  i  —  s)  E  A',  some  s  6  [0,  A/])  +  e 

_  (2.12) 
=  P°(X{t  —  M  +  s)  £  A',  some  s  £  [0,  Afl)  +  e 

=  P°(A(u  +  s)  £  A,  some  s  £  [0,  A/])  4- e. 

where  u  =  I  —  M  But  now  we  are  dealing  with  the  non-delayed  version  of  X  which  we  just  showed 
was  tight;  thus  for  any  (5  >  0  we  can  choose  a  compact  set  of  paths  C(€)  C  V  such  that  for  all  t  >  0, 
P°{9t  o  X  £  C(€))  >1—6.  Using  this  fact  together  with  the  compact  containment  condition,  it  follows  the 
last  probability  in  (2.12)  can  be  made  arbitrarily  small  (uniformly  over  u  >  0)  for  appropriate  compact  sets 
K  C  S.  This  is  because  the  complement  of  the  event 

{X(u s)  £  TT,  some  s£[0,A/]} 

is  the  event 

{X(u-|-s)£A,  for  all  s£[0,Af]}. 

For  1  <  A/  we  can  use  the  compact  containment  condition  on  X  over  the  time  interval  [0,  A/]  to  obtain 
a  compact  set  A  such  that  P(X{t)  £  A)  >  1  —  <  for  all  t  £  [0,  A/].  The  proof  is  now  complete.  The  last 
assertion  of  our  theorem  follows  by  applying  our  result  to  synchronous  process  X  (of  Proposition  1.3).  ■ 

Corollary  2.1  Suppose  X  is  a  PRS  and  let  Y(t)  =  ^/v(<)+i  ~  ^  denote  the  time  until  the  next  synch  time 


after  time  t.  Then  Y  is  tight. 


Proof:  Y  is  e2»siiy  seen  to  be  a  PFIS  with  the  s2Lme  synch  times  as  X.  ■ 

Corollary  2.2  If  X  is  a  PRS  and  f  is  continuous  mapping  from  S  into  a  complete  separable  metric  space 
Si  then  {/(X(<))}  is  tight. 

Proof:  f{X(t))  has  paths  in  Ps,  and  is  PRS  wtt  the  same  synch  times  as  X.  ■ 

Corollary  2.2  may  fail  if  the  path  regularity  of  P  is  not  enforced.  The  importance  of  this  is  that 
measurable  functions  of  aPRS  X  need  not  be  tight  since  f{X{t))  may  no  longer  have  paths  in  P. 

Example  (2)  A  functional  of  a  PRS  that  is  not  tight.  Let  B(t)  be  the  forward  recurrence  time  for  the 
deterministic  renewal  process  {tn};  tn  =  n  (n  >  0).  Define  /(x)  =  l/x.  x  e  (0, 1].  Then  does  not 

have  a  limit  from  the  left  at  any  integer  point;  in  fact  for  each  n,  f[B{t))  — ►  oo  as  t  — >  n.  In  particular, 
f{B{t))  is  not  tight. 

3.  Applications  to  queueing  models 

In  Sigman  [1989],  a  variety  of  queueing  models  were  shown  to  have  representations  in  continuous  time  as  a 
one-dependent  regenerative  process  (od-R).  An  od-R  process  X  is  a  synchronous  process  for  which  the  cycles 
are  one  dependent,  that  is  X„  is  dependent  upon  X„+i  but  is  independent  of  {Xn-k;k  >  2}.  In  particular, 
a  positive  recurrent  od-R  process  is  an  ergodic  PRS. 

Together  with  Theorem  2.1  we  now  can  obtain  a  variety  of  new  tightness  results  for  such  things  as  queue 
length.  We  present  two  sucti  results  as  an  iliustralion. 

One  large  class  of  models  are  those  that  can  be  represented  at  exogenous  arrival  epochs  as  a  Harris 
recurrent  Markov  chain  C  =  {Cn}.  As  shown  in  Sigman  [1989]  these  models  inherit  a  one-dependent 
regenerative  structure  (od-R)  from  C  when  represented  as  a  process  Z  in  ccntinuriKs  time.  Our  first  example 
is  the  simplest  non-trivial  exeimple  of  this  type;  the  classic  FIFO  G//G//c  queue  (see  for  example,  page  493 
of  Wolff[1989]).  The  interarrival  time  and  service  time  distributions  are  only  assumed  to  have  finite  first 
moment  (no  non-lattice  or  spread-out  assumptions!).  A  and  p  denote  the  Mrival  and  service  rate  respectively. 
Q(t)  denotes  the  number  of  customers  waiting  in  the  queue  (not  in  service)  at  time  t.  Y(t)  is  the  c-tuple  of 
residued  service  times.  B(t)  denotes  the  forward  recurrence  time  of  the  exogenous  renewal  process  of  arrivals. 
K(t)  denotes  a  list  of  the  service  times  of  ail  customers  waiting  in  the  queue  at  time  t.  V(t)  denotes  the 
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total  worlc  in  system  process,  that  is.  the  sum  of  ail  remaining  service  times  of  all  customers  in  the  system 
at  time  t. 

Proposition  3.1.  For  a  FIFO  GllCIjc  queue,  if  0  <  A  <  cp  then  regardless  of  initial  conditions  the 
queue  length  process  Q(t)  and  the  total  work  in  system  process  K(t)  are  tight. 

Proof:  From  Proposition  8.1  of  Sigman  [1989]  it  follows  that  the  process  Z{t)  =  Bit). 

is  a  positive, Harris  Recurrent  .Markov  process  and  hence  is  positive  recurrent  od-R  (Theorem  2  of  Sigman 
[1989]).  Both  V(t)  and  Q{t)  are  continuous  functionals  of  Z  and  hence  for  any  fixed  inital  state  each  f^rias 
an  (ergodic)  PRS  (with  the  same  synch  times  as  Z)  and  hence  is  tight.  ■ 

We  mention  that  the  same  kind  of  result  above  can  be  derived  for  open  queueing  networks  having  i.i.d 
e.xogenous  interarrival  times  (general  distribution,  finite  fiorst  moment),  i.i.d.  service  times  (general  distri¬ 
butions,  finite  first  moment)  and  Mairkovian  routing.  These  are  sometimes  called  Open  Jackson  Setworks 
with  general  i.i.d.  input. 

Our  second  example  is  a  single  server  queue  with  input  (the  marked  point  process  of  arrival  and  service 
times)  governed  by  a  Harris  recurrent  .Markov  process  (HRMP)  (see  section  7  of  Sigman  [1989]).  The  idea 
here  is  that  the  queue  inherits  the  od-R  structure  of  its  input.  A  denotes  the  long  run  arrival  rate  and  p  the 
long  run  service  rate:  o  "=  X/ p.  We  do  not  assume  the  FIFO  discipline;  any  work  conserving  discipline  is 
allowed. 

Proposition  3.2.  For  a  single  server  queue  with  input  governed  by  a  positive  HRMP.  if  0  <  p  <  I  then 
regardless  of  initial  conditions  the  queue  length  process  Q{t)  and  the  total  work  in  system  process  V'(0  are 
tight. 

Proof:  Analogous  to  the  proof  of  Proposition  o.i.  from  .'’rc'position  7.1  of  Sigman  [1989],  both  Q(t)  and 

V{t)  are  continuous  functionals  of  a  positive  HRMP  and  hence  PRS.  ■ 

RemarkfS.l):  It  is  known  that  in  general,  Q{t)  and  V{t)  for  the  above  models  do  not 
converge  weakly  to  their  steady-state  distributions.  For  the  FIFO  CIlGI/c,  if  the  inter- 
arrival  time  distribution  is  spread-out  then  weak  convergence  is  obtained  (in  fact  in  total 
variation). 
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